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spective. More specifically, we want to know if a connection exists between 
an individual’s creativity and his or her evaluation of creative products. We 
also want to know what role cognitive style plays in this relationship. The 
sample (139 second-year undergraduates) was collected from an art and 
design program of an institution in Macau. Convenience sampling was used 


for the current study. The present study found partial support for the associa- 
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tions between cognitive style, creativity, and evaluations of creative products. 
Based on zero-order correlations, visual and verbal cognitive styles were 


moderately and positively correlated to three components of CPSS (novelty, 
resolution, and elaboration and synthesis). The results of the SEM further 
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1. INTRODUCTION 


A significant number of studies from 
different fields, including cognitive and de- 
velopmental psychology, neuroscience, edu- 
cation, business management, and arts, have 
contributed to advancing our understanding 
of creativity in people (Hadani and Jaeger, 
2015). With regard to assessing creativity, ask- 
ing respondents to produce creative products 
is considered one of the more valid methods 
(Kaufman, Bear, and Cole, 2009; Tsai, 201 6a). 
As Kaufman and Baer (2012) state, “when it 
comes to judging real-world creative products 
... they ask experts. Not everyone will agree 
with every expert opinion. Yet there is no 
higher court of appeal” (pp. 83-84). 
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confirm this relationship between cognitive style and CPSS (1 = .69, p < .05). 
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Runco, Paek, and Jaeger (2015) exam- 
ined funded papers published by three major 
journals related to creativity: Creativity Re- 
search Journal; Psychology of Art, Creativ- 
ity, and Aesthetics; and Journal of Creative 
Behavior. Among them, the topic of creativ- 
ity accounted for 22.5% of a total of 707 pa- 
pers. They also found that three major funding 
sources supporting research on creativity and 
giving out the largest number of awards were 
in Asia: the National Science Foundation, 
Ministry of Education of China, and Social 
Sciences and humanities Research Council of 
Canada. Although these numbers reported in 
their paper were remarkable, the authors con- 
cluded that creativity research is still not sup- 
ported in the global market. 

Although creativity is regarded as an 
important topic in society as a whole, it seems 
that the market for creativity is nowhere near 
its full possible momentum. Therefore, the 
current study investigates creativity from a 
creative product perspective. More specifi- 
cally, we want to know if a connection exists 
between an individual’s creativity and his or 
her evaluation of creative products. We also 
want to know what role cognitive style plays 
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in this relationship. To our knowledge, the em- 
pirical studies examining these three variables 
are limited; more research is needed to explore 
this line of thought. 

Creativity and imagination are used in- 
terchangeably. Creativity is treated as com- 
plex and multifaceted in nature; there is no 
universally accepted definition of creativity 
in the literature. With regard to the character- 
istics of creativity characteristics, Treffinger, 
Young, Selby, and Shepardson (2002) clus- 
tered four categories: generating ideas, dig- 
ging deeper into ideas, openness and courage 
to explore ideas, and listening to one’s inner 
voices. Generating ideas concerns cognitive 
abilities such as divergent thinking, creative 
thinking, or metaphorical thinking. Digging 
deeper into ideas 1s related to cognitive char- 
acteristics such as convergent thinking or 
critical thinking. The openness and courage 
to explore ideas category involves addressing 
some personality traits. Finally, listening to 
one's inner voice concerns a level of personal 
understanding, vision, and commitment (vii1). 

In their white paper on promoting crea- 
tivity in children, Hadani and Jaeger (2015) ar- 
gue that seven critical components that should 
be addressed for successfully facilitating cre- 
ativity in the classroom: (a) imagination and 
originality: pretend play 1s an effective tool for 
children to exercise their imagination and ex- 
press original ideas; (b) flexibility: exposing 
children to diverse experiences and encourag- 
ing them to be open minded will enhance flex- 
ible thinking, which is an important element in 
the creative process; (c) decision-making: cre- 
ative ideas stem from three stages—problem 
identification, divergent thinking, and evalua- 
tion—and it is a cyclical process—namely, 
developing accurate evaluations about what 
is best and creative idea is an important skill 
to learn; (d) communication and self-expres- 
sion: effective communication 1s an important 
tool for not only expressing an individual’s 
unique ideas but also making audiences un- 
derstand them—metaphor and humor are two 
vital devices to express thoughts; (e) motiva- 
tion: when children are intrinsically motivat- 
ed without the promise of a reward, they are 
more likely to be creative; (f) collaboration: 
successful peer collaboration can lead to 1m- 
portant contributions to group creativity; and 
finally, (g) action and movement: regular exer- 
cise and physical motion can boost children’s 
creative potential. Overall, Hadani and Jaeger 
delineated their arguments supported by em- 
pirical studies and most importantly, they also 
provided useful tips and activities to enhance 


children’s creativity in their appendix. 

With regard to creativity assessment, 
Treffinger, Young, Selby, and Shepardson 
(2002) pointed out four different approaches 
to gather data about individuals’ creative po- 
tential: (a) behavior or performance data (ac- 
tual creative products and performances); (b) 
self-report data (e.g., attitude inventories, per- 
sonal checklists, or biographical inventories); 
(c) rating scales (e.g., using ratings by teach- 
ers, parents, or peers); and (d) tests adminis- 
trated under standardized conditions. Treffin- 
ger, Young, Selby, and Shepardson (2002) 
further suggested that it is unwise to count on 
a single instrument to capture individuals’ cre- 
ative strengths (xi1-x111). 

According to the monograph of Treffin- 
ger, Young, Selby, and Shepardson (2002), cre- 
ativity can be measured and, most important- 
ly, creativity can be assessed in a systematic 
manner. A number of scholars have proposed 
different definitions of creativity that place 
different emphasis on creativity. Among them, 
creative products and outcomes are one of the 
approaches for assessment (Tsai, 2016b). 

Several students of creativity believe 
that evaluating creative products or perfor- 
mance via experts in that domain is superior 
to other methods because this seems to better 
reflect individual real-life creativity (Baer and 
McKool, 2009; Carson, Peterson, and Hig- 
gins, 2005). Among them, Amabile (1982) 
proposed a consensual definition of creativ- 
ity: “a product or response is creative to the 
extent that appropriate observers independent- 
ly agree it 1s creative. Appropriate observers 
are those familiar with the domain in which 
the product was created or the response articu- 
lated” (p. 1001). Based on Amabile’s consen- 
sual assessment technique (CAT), a number of 
requirements and procedures are needed for 
properly assessing creative products: first, ex- 
pert judges who are familiar with the domain 
need to be recruited; second, the judges must 
make their assessments independently; third, 
these judges should not be given specific cri- 
teria for judging creativity; and fourth, judges 
should be instructed to rate the products rel- 
ative to one another on the dimensions in 
question (p. 1002). 

The main reason for supporting this 
method is grounded in the notion that “Nobel 
prize committees do not apply rubrics, com- 
plete checklists, or score tests. What do they 
do? They ask experts. The most valid assess- 
ment of the creativity of an idea or creation 
in any field is the collective judgment of [the] 
recognized experts in that field’ (Baer and 
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McKool, 2009, p. 2). One of the merits of 
the CAT is the ability to measure gardenva- 
riety creative products. More specifically, as 
Kaufman, Lee, Baer, and Lee (2007) pointed 
out, “there is no more objective or valid mea- 
sure of the creativity of a work of art than the 
collective judgments of artists and art critics” 
(p. 98). As a result, many creativity scholars 
highly support the use of CAT, in the assess- 
ment of individuals’ creativity (Kaufman, 
Baer, Cole, and Sexton, 2009). 

Cognitive style refers to how people 
process and represent information (Mayer and 
Massa, 2003). From this perspective, indi- 
viduals can be differentiated from visualizers 
and verbalizers, where the former prefer us- 
ing images to process and present information, 
and the latter prefer using words. Mayer and 
Massa (2003) examined 14 measures by using 
exploratory factor analysis with varimax rota- 
tion and the results suggested that the visual- 
izer-verbalizer dimension is multifaceted, 1n- 
cluding individual differences in ability, style, 
and preference. More specifically, for cogni- 
tive ability, people with high spatial ability 
have a tendency of high proficiency 1n creat- 
ing and manipulating spatial representations. 
As far as cognitive style is concerned, visual- 
izers usually prefer visual modes of thinking. 
Finally, regarding learning preference, visual 
learners prefer instructions involving pictures. 

Cognitive style has been extensively 
researched in the education literature. For 
example, there are studies on learning sys- 
tems (Lo, Chan, and Yeh, 2012), academic 
performance (Al Salameh, 2011), spatial ex- 
periences (Erkan Yazici, 2013), self-efficacy 
(Harder, Czyzewski, and Sherwood, 2015), 
and learning strategies (Shi, 2011). A number 
of studies have focused on the relationships 
between cognitive styles and creativity (e.g., 
Dew, 2009; Kozhevnikov, Kozhevnikov, Yu, 
and Blazhenkova, 2013; Noppe, 1985; Pektas, 
2010). These studies suggest that different 
cognitive styles have effects on real-life cre- 
ative behavior. For instance, after conducting a 
battery of cognitive tests on Canadian college 
students, Choi and Sardar (2011) used a step- 
wise regression analysis to find that spatial 
abilities predicted visual cognitive style and in 
turn predicted visual learning preferences. Vo- 
cabulary knowledge predicted verbal cogni- 
tive style, but not verbal learning preferences. 
Based on the object of the study, our sample 
was art and design undergraduates; therefore, 
the current study especially employed visual- 
verbal preferences as their cognitive style, 
which might reflect the specific nature of our 
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subjects. 

The main purpose of the current study 
was to explore the interrelationships among 
individuals’ creativity, their ability to assess 
creative products, and their cognitive styles. 
The unique contribution of the present study 
lies in the composition of the sample. The cur- 
rent study recruited art and design students to 
provide more information for art and design 
educators to facilitate creativity in their class- 
rooms. Another important contribution is to 
that the scarce research concerning the three 
target variables (individuals’ creativity, their 
ability to assess creative products, and their 
cognitive styles). Thus, following this line of 
thoughts, we asked two questions: (a) Is there 
a relationship among creativity, evaluating 
creative products, and cognitive style? And 
(b) if so, what is the interaction among these 
relationships? 


2. MATERIALS AND METHODS 


The sample was collected from an art 
and design program of an institution in Ma- 
cau. Convenience sampling was used for the 
current study. Participants were 139 second- 
year Chinese undergraduates recruited from 
five classes; among them 81 were women, and 
58 were men. The average age of the students 
was 21.11 years (SD = 3.35 years). These re- 
cruited students received 40 MOP (about 5 
USD) as their incentive for participating in the 
study. All participants signed consent forms 
and were assured of confidentiality and ano- 
nymity. 

The Creative Product Semantic Scale 
(CPSS; Besemer and O’Quin, 1986) was 
used as a measurement to evaluate creative 
products. The development of the CPSS was 
based on the Creative Product Analysis Matrix 
(CPAM; Besemer and Treffinger, 1981), which 
is intended to help nonpractitioners evaluate 
creative products in a systematic manner. The 
CPSS involves three dimensions—novelty, 
resolution, and elaboration and synthesis— 
and is scored on a 7-point Likert-type scale 
with 55 item pairs. Each of the nine subscales 
is created using four or five items of pairs of 
adjectives (Besemer, 1998). 

For our study, we used a 15-item CPSS 
(White, Shen, and Smith, 2002), which was 
translated from English to Chinese by the re- 
searcher, collected from the original 55-1tem 
CPSS, with three of the eleven original sub- 
scales being used—originality, logic, and well 
craftedness. Each of the three subscales had 
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five items, which consisted of three dimen- 
sions: novelty, resolution, and elaboration 
and synthesis. The main reason for using this 
abridged version of the CPSS was that Karen 
O’Quin, one of the scale’s original develop- 
ers, recommended that the 15-1item CPSS can 
avoid the fatigue created among evaluators 
by using the longer instrument (White et al., 
2002). The scoring of the CPSS 1s constructed 
by taking the mean of the items that make up 
the sub-scale. For example, the subscale origi- 
nal has five items (pairs of adjectives): over- 
used-fresh, predictable-novel, usual-unusual, 
unique-ordinary, and original-conventional. 
A participant’s score for original is comput- 
ed by taking the mean of the scores of these 
items. Finally, the scoring of the CPSS of the 
three dimensions was done by using the aver- 
age scores of three chair works for evaluation. 
Regarding reliability analyses for the CPSS, 
Besemer, 1998 reported a coefficient alpha 
for the novelty dimension from .84 to .86, for 
resolution from .79 to .85, and for elaboration 
and synthesis from .84 to .87. Additionally, 
through the use of confirmatory factor anal- 
ysis, a three-factor model was also confirmed 
and validated. 

Abbreviated Torrance Test for Adults 
(ATTA; Goff and Torrance, 2002), a shortened 
version of the Torrance Test of Creative Think- 
ing (TTCT; Torrance, 1966), was used to mea- 
sure creative thinking ability. The ATTA uses 
three tasks (one verbal task and two figural 
tasks) to measure the creativity of adults by 
quantifying figural and verbal creative poten- 
tials, which consist of four abilities: fluency 
(quantities of produced ideas), originality (un- 
common or unique ideas), elaboration (em- 
bellishing ideas with details), and flexibility 
(processing information in different ways). 
In our study, fluency, originality, elaboration, 
and flexibility were calculated, guided by the 
ATTA manual. 

The current study used the Chinese ver- 
sion of ATTA (Chen, 2006), which has been 
extensively tested and has proven its validity 
in the Taiwanese sample (Shen and Lai, 2014; 
Wang, 2012). Chen (2006) reported that the 
test-retest reliability was .340—.682 (p < .01). 
The verbal part of the correlational coefficient 
in criterion-referenced creativity indicators 
was .457 (p < .01), and the figural part was 
.368 (p < .01). Since the participants in the 
current study were going to be young Chinese 
adults in Macau, the ATTA was selected as a 
measurement tool. 

We used the Verbalizer- Visualizer Ques- 
tionnaire (VVQ; Richardson, 1977) to assess 


the visualizer-verbalizer dimension. The origi- 
nal VVQ contains 15 items and asks partici- 
pants to judge how they use to their style of 
thinking via a true-false response. The current 
study used a 7-point Likert-type scale, rang- 
ing from | (strongly disagree) to 7 (strongly 
agree), following Mayer and Massa’s (2003) 
suggestion. Mayer and Massa reported that 
the Cronbach alpha for the VVQ was .71. Two 
averaged scores were calculated: one for ver- 
bal cognitive style and one for visual cognitive 
style. 

The participants were first informed of 
the purpose of the study and the procedure of 
the test. They were asked to provide basic in- 
formation, such as their gender and age. Then 
the ATTA was conducted, and each task was 
allowed three minutes for completion. It took 
about 10 minutes to finish this session. Finally, 
our respondents were asked to evaluate cre- 
ative products via the 15-item CPSS and the 
VVQ. It took about 20 minutes to complete 
the evaluation. The whole process was com- 
pleted within 30 minutes. 

Inspired by Besemer’s (1998) study, the 
current study used three chairs as the prompt 
and collected them from the Vitra Design 
Museum (http://www.design-museum.de/ 
en/collection/100-masterpieces.html). On its 
website, the museum exhibits 100 masterpiec- 
es of chairs from 1900 to 1990. The criteria 
for selecting chairs is highly novel and also 
beyond the expected functionality of the chars 
for real-life use. Three slides of three chair il- 
lustrations as stimulus items were selected by 
the researcher and evaluated by our partici- 
pants as follows: Marc Newson, Lockheed 
Lounge, 1985/86; Verner Panton, Living Tow- 
er, 1968/69; and Achille and Pier Giacomo 
Castiglioni, Mezzadro, 1954/57. 


3. RESULTS 


Pearson correlation coefficient was used 
to examine relationships among nine variables. 
Table 1 shows that fluency was positively cor- 
related with originality, elaboration, flexibility, 
novelty, and resolution. There were no statis- 
tically significant correlations between origi- 
nality and other variables. Elaboration was 
only statistically significant correlated with 
flexibility. Novelty was positively correlated 
with resolution, elaboration and synthesis, and 
verbal and visual cognitive style. Elaboration 
and synthesis was also positively correlated 
with verbal and visual cognitive style. Finally, 
verbal and visual cognitive styles were posi- 
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tively correlated with each other. 


Table 1. Pearson correlation coefficients among nine variables. 


Variable 1 2 3 4 5 6 7 8 9 
1. Fluency = 

2. Originality 23** -. 

3. Elaboration .20* 13 -- 

4. Flexibility a4 * one et 

5. Novelty a .O1 .03 -.05 ~~ 

6. Resolution te .06 -.01 -.01 51**  -- 

7. Elaboration and 16 ll 10 .09 51** Fare -- 

_Symthesis 
8. Verbal cognitive ll Ad 12 02 4A2** 38** Adee _L 

style 

9. Visual cognitive .05 .04 10 -.01 ASF* 4A5** 5D** 61**  -- 
style 


To better understand the interactions 
among these variables, structural equation 
modeling (SEM) was used. A visual diagram 
is shown 1n Figure 1. 
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Figure 1. Standardized coefficients for 
model of creativity, cognitive style, and CPSS. 
? 05; 


Overall model fit shows that y2 = 26.89, 
df= 24, p=.31, y2/ df= 1.12, GFI = .959, CFI 
= 991, NFI = .992, RMSEA = .03. Based on 
Hair, Black, Babin, Anderson, and Tatham’s 
(2006) guidelines for establishing acceptable 
model fit, the results show that our model at- 
tained a reasonable good fit. When examining 
the relationships among creativity, cognitive 
style, and CPSS, we found that only cognitive 
style and CPSS were significantly correlated 
(r = .69). The estimates relationships (paths) 
are also shown in Figure 1. When we looked 
at the first construct creativity, we found that 
the estimated regression coefficients for flu- 
ency, originality, elaboration, and flexibility, 
were .68, .32, .39, and .52, respectively, and 


the sizes of these coefficients indicated that 
fluency has the biggest impact on creativity. 
For cognitive style, we found that visual cog- 
nitive style had the strongest impact (.86). For 
CPSS, novelty had the strongest impact (.88). 


4. DISCUSSIONS 


The present study found partial support 
for the associations between cognitive style, 
creativity, and evaluations of creative prod- 
ucts. Based on zero-order correlations, visual 
and verbal cognitive styles were moderately 
and positively correlated to three components 
of CPSS (novelty, resolution, and elaboration 
and synthesis). The results of the SEM further 
confirm this relationship between cognitive 
style and CPSS (r= .69, p < .05). 

Unexpectedly, both cognitive styles 
were not associated with the four components 
of creativity (fluency, originality, elaboration, 
and flexibility). It may be that the VVQ is not 
a proper measure for capturing creativity as 
measured by divergent-thinking tests like the 
ATTA in the current study. Although the VVQ 
is a major instrument used in research related 
to the visualizer-verbalizer dimension (Mayer 
and Massa, 2003), our study seems to sug- 
gest that the visualizer-verbalizer dimension 
did not fit the criterion of creativity. Based on 
our knowledge, studies involving VVQ and 
creativity are scarce, and so more research 
is needed to further confirm connections be- 
tween visualizer-verbalizer dimension and 
creativity. 

Concernig the relationship between cre- 
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ativity nd CPSS, we found that only fluency 
was positively related to novelty and resolu- 
tion This suggests that fluency is probably te 
most important variable in creativity (Runco 
and Acar, 2012), which is also supported by 
our SEM model. Moreover, according to the 
results from SEM results, creativity was not 
significantly related to cognitive style and 
CPSS. 

Overall, our findings suggest that indi- 
viduals’ cognitive style, not their creative po- 
tential, was related to their assessment of cre- 
ative products. Our results are consistent with 
other studies that suggested that individual 
differences in visual-verbal cognitive style are 
valid (Choi and Sardar, 2011) and have an 1m- 
pact on the ability to assess creative products. 
In the SEM model, we found that in cognitive 
style, visual style 1s more important than ver- 
bal style and in the CPSS, novelty is the most 
influential variable. 

While our results are informative, sev- 
eral limitations should be noted when inter- 
preting the findings of the current study. For 
instance, we used a divergent thinking test 
rather than real-life creative performance as 
the index of creativity. Although divergent 
thinking tests enjoy popularity in the creativ- 
ity literature, several issues with the scoring 
systems were discussed in the literature (Sil- 
via et al., 2008). Moreover, several scholars 
suggest that the real-life creative achieve- 
ments generated by participants and evalu- 
ated by experts may be better than divergent 
thinking tests for capturing creative potential 
(Kaufman et al., 2008). As a result, for fur- 
ther research, it would be prudent to use other 
approaches and methods to accurately assess 
creativity. Another salient limitation is that our 
sample was recruited from one institution and 
one ethnic group. Cross-cultural studies seem 
to a promising direction for further validating 
the current findings. Finally, our study was a 
correlational study in nature. In terms of re- 
search design, using an experimental study can 
provide robust findings for future researchers 
to understand the interplay among these three 
variables. 


5. CONCLUSIONS 


The relationship among cognitive style, 
creativity, and assessment of creative prod- 
ucts by Chinese undergraduates in Macau was 
partially supported by our study. In addition to 
contributing to the literature, the present study 
has direct implications for instructional prac- 


tices in art and design education. Our finding 
that cognitive style was related to assessment 
of creative products implies that when edu- 
cators ask their students to evaluate creative 
products and provide feedback, teachers 
should take students’ cognitive style in terms 
of the visual-verbal dimension into consider- 
ation. Based on the present findings, visual 
cognitive style was more important that verbal 
cognitive style for assessing creative products. 
This implies that visually based instructional 
methods should be used and emphasized dur- 
ing the assessment session. 

The practical implications of the cur- 
rent study are that for art and design educa- 
tors, it is necessary to consider their students’ 
cognitive style in order to facilitate creativ- 
ity in the classroom. In our sample, we found 
that visual style is more important than verbal 
style, which might reflect their majors—art and 
design. Additionally, our study successfully 
demonstrate that the usefulness of the CPSS. 
Specifically, in art and design education, peer 
critique and peer feedback are essential train- 
ing for students. Consequently, it is suggest- 
ed that educators could bring the CPSS into 
their curriculum development. The CPSS 
could serve as a guideline for art and design 
students to assess others’ works. Finally, we 
used ATTA as the indicator of creative poten- 
tial. In the creativity assessment market, there 
are numerous possible options for researchers 
to use. We suggest that for future researchers 
alternative method is beneficial. For exam- 
ple, we could ask participants to create real art 
and design works and then these design works 
could be evaluated by experts. The research- 
ers could employ the CAT, which has been 
discussed in our literature review. In short, the 
current study presents some aspects of creativ- 
ity, which has important implications for stu- 
dents of creativity. 
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